A Metric Entropy Bound is Not Su cient for
نویسندگان
چکیده
We prove by means of a counterexample that it is not suucient, for PAC learning under a class of distributions, to have a uniform bound on the metric entropy of the class of concepts to be learned. This settles a conjecture of Benedek and Itai.
منابع مشابه
Minimax Nonparametric Classi cation|Part I: Rates of Convergence
|This paper studies minimax aspects of nonparametric classi cation. We rst study minimax estimation of the conditional probability of a class label, given the feature variable. This function, say f; is assumed to be in a general nonparametric class. We show the minimax rate of convergence under square L2 loss is determined by the massiveness of the class as measured by metric entropy. The secon...
متن کاملFixed point results for Su-type contractive mappings with an application
In this paper, we introduce the concept of Su-type contractive mapping and establish fixed point theorems for such mappings in the setting of ordered extended partial $b$-metric space. We also develop an application for Fredholm type integral equations to validate our main result and a non-trivial example is given to elucidate our work.
متن کاملThe Rate of Rényi Entropy for Irreducible Markov Chains
In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.
متن کاملEntropy of a semigroup of maps from a set-valued view
In this paper, we introduce a new entropy-like invariant, named Hausdorff metric entropy, for finitely generated semigroups acting on compact metric spaces from a set-valued view and study its properties. We establish the relation between Hausdorff metric entropy and topological entropy of a semigroup defined by Bis. Some examples with positive or zero Hausdorff metric entropy are given. Moreov...
متن کاملDefinition of General Operator Space and The s-gap Metric for Measuring Robust Stability of Control Systems with Nonlinear Dynamics
In the recent decades, metrics have been introduced as mathematical tools to determine the robust stability of the closed loop control systems. However, the metrics drawback is their limited applications in the closed loop control systems with nonlinear dynamics. As a solution in the literature, applying the metric theories to the linearized models is suggested. In this paper, we show that usin...
متن کامل